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Purpose: To access the predictive value of the European Randomized Screening 
of Prostate Cancer Risk Calculator (ERSPC-RC) and the Prostate Cancer Preven- 
tion Trial Risk Calculator (PCPT-RC) in the Korean population. Materials and 
Methods: We retrospectively analyzed the data of 5 17 men who underwent tran- 
srectal ultrasound guided prostate biopsy between January 2008 and November 
2010. Simple and multiple logistic regression analysis were performed to compare 
the result of prostate biopsy. Area under the receiver operating characteristics 
curves (AUC-ROC) and calibration plots were prepared for further analysis to 
compare the risk calculators and other clinical variables. Results: Prostate cancer 
was diagnosed in 125 (24.1%) men. For prostate cancer prediction, the area under 
curve (AUC) of the ERSPC-RC was 77.4%. This result was significantly greater 
than the AUCs of the PCPT-RC and the prostate-specific antigen (PSA) (64.5% 
and 64.1%), respectively, j9<0. 01), but not significantly different from the AUC of 
the PSA density (PSAD) (76.1%, j!?=0.540). When the results of the calibration 
plots were compared, the ERSPC-RC plot was more constant than that of PSAD. 
Conclusion: The ERSPC-RC was better than PCPT-RC and PSA in predicting 
prostate cancer risk in the present study. However, the difference in performance 
between the ERSPC-RC and PSAD was not significant. Therefore, the Western 
based prostate cancer risk calculators are not useful for urologists in predicting 
prostate cancer in the Korean population. 
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Prostate cancer incidence varies tremendously across the world depending on eth- 
nic, genetic, diet and environmental factors. Prostate cancer incidence is very high 
in the United States and Europe, where prostate-specific antigen (PSA) screening is 
most common. Recently, there has been a rapid increase of the incidence of prostate 
cancer in Korean due to an increase in PSA screenings even though the incidence in 
Asia is lower than in Westem countries.'-^ The European Randomized Screening of 
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Prostate Cancer (ERSPC)^^ and the Prostate Cancer Pre- 
vention Trial (PCPT)'' ' have each introduced online pros- 
tate cancer risk calculators (RC). These instruments were 
created based on 6288 Dutch males and 5519 North Ameri- 
can males of several different ethnic backgrounds. These 
prostate cancer risk calculators are based on race, age, se- 
rum PSA level, prostate volume, family history, outcome of 
digital rectal exam, transrectal ultrasound (TRUS) findings, 
and status of prior biopsy. These two online risk calculators 
were also validated in several Westem cohorts.''^ " 

However, no research exists investigating the applicabili- 
ty of these tools in Asian populations considering the low 
overall incidence rate of prostate cancer Therefore, we in- 
vestigated the predictive ability of the two online calcula- 
tors-PSA alone and PSA density-to determine whether these 
tools can be applied in the Korean population. 



MATERIALS AND METHODS 



A retrospective analysis was performed on 625 male pa- 
tients who underwent systemic 12-core TRUS-guided biop- 
sy consecutively in our institution between January 2008 
and November 2010. According to limitations of each cal- 
culator, 24 men with a PSA level <0.5 ng/mL or >50 ng/mL 
(limitation of ERSPC-RC), 1 man with prostate volume 
<10 mL or >150 mL (limitation of ERSPC-RC) and 84 
men with age <55 years old (limitation of PCPT-RC) were 
excluded. In total, 122 men were excluded. Therefore, 517 
cases were ultimately used for analysis. Patients were re- 
ferred for biopsy if there was suspicious malignancy, if 
PSA elevation was observed during follow-up and/or if 
PSA >4.0 at initial screening without evidence of benign 
condition for PSA elevation. 

Clinical factors evaluation 

To obtain risk estimates, necessary predictor variables for the 
tools were gathered, including age, family history, status of 
prior prostate biopsy, PSA level, prostate volume, distal rectal 
exam (DRE) findings, TRUS findings and history of 5-alpha 
reductase inhibitor (5-ARI) use. PSA density (PSAD) was 
calculated by dividing the PSA level by the prostate volume. 

Risk calculators 

Variables of the PCPT-RC included race, age, PSA level, 
family history, abnormalities of DRE, prior status of biopsy 
and history of 5-ARI use. For the ERSPC-RC, the four 



PCPT-RC variables of PSA level, abnormalities of DRE, 
prior status of biopsy and history of 5-ARI use, the two ad- 
ditional predictors of prostate volume and TRUS findings 
were used. In the ERSPC-RC, PSA was doubled for pa- 
tients taking a 5-ARI more than 1 year before perfomiing 
risk calculations, although the use of 5-ARI is not a vari- 
able for ERSPC-RC. PSA doubling was already accounted 
for as a variable in the risk calculations of the PCPT-RC. 
And we used the ERSPC-RC 4 to calculate risks for pa- 
tients undergoing initial biopsy, whereas the ERSPC-RC 5 
was used for those who had a previous negative biopsy. 

Statistical analysis 

Continuous variables were reported as median and range 
values and categorical variables were reported as their 
number and frequency. Chi-square tests and ANOVA were 
used for statistical comparison of continuous and categori- 
cal variables, respectively. Simple and multiple logistic re- 
gressions were performed to identify independent predic- 
tors of prostate cancer during biopsy. The area under the 
receiver operating characteristics curve (AUC) was calcu- 
lated for both risk calculators, PSA and PSAD for PSA 
screening cohort. Differences in predictive accuracy esti- 
mates were tested for statistical significance using the Hos- 
mer and Lemeshow test. Performance characteristics of the 
risk calculators were examined using calibration plots, 
where the x-axis represented the predicted probability and 
the y-axis represented the actual observed proportion of 
positive biopsy results. 

All tests were two-sided with significance noted at 0.05. 
Statistical analyses were performed using the SAS statisti- 
cal package (Version 9.1; SAS Institute, Cary, NC, USA). 



RESULTS 



Prostate cancer was diagnosed in 125 patients (24.1%). The 
characteristics of the total study population of 517 patients 
are shown in Table 1 . In the simple logistic regression anal- 
ysis, family history, previous biopsy history and history of 
5-ARJ use were not statistically significant predictors of 
prostate cancer In the multiple logistic regression analysis 
with a backward variable selection procedure, the signifi- 
cant predictors of prostate cancer were age, PV, and PSA 
level (Table 2). 

A significantly higher AUC was observed for the ERSPC- 
RC (77.4%) compared to the PCPT-RC (64.5%) and PSA 
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level alone (64.1%) in the total patient group (/7<0.01). How- 
ever, there was no statistically significant diflference in AUC 
between the ERSPC-RC (77.4%) and PSAD (76.1%) 
(f»=0.54) (Fig. lA). When we compared the AUCs in the 
over 4.0 ng/mL PSA group, the ROC analyses showed an 
AUC for the ERSPC-RC of 77.7%, for the PCPT-RC of 

Table 1. Baseline Characteristics of Patients 



64.3%, for PSA level alone of 63.6% and for PSAD of 
76.9%. In the PSAD over 0.15 group, the ROC analyses 
showed respective AUC values of 75.3%), 61.2%, 56%, and 
71.1%o. Statistically significant differences were also ob- 
served between the ERSPC-RC and the PCPT-RC and PSA 
in the two separate groups. However, there was no statisti- 





Total 


Positive 


Negative 


p value 


Patients 


517 


125 


392 


<0.01 


Age 


55-64 


231 


43 


188 


<0.01 


65-74 


227 


61 


166 




>75 


59 


21 


38 




PSA level, mean 


8.1 (±6.1) 


11.0 (±8.8) 


7.2 (±4.5) 


<0.01 


<2.5 


7 


0 


7 


<0.01 


2.5-3.99 


69 


11 


58 




4.0-9.99 


342 


73 


269 




10-19.99 


72 


22 


50 




>20 


27 


19 


8 




PV, mean 


45.1 (±17.3) 


36.5 (±13.0) 


47.9 (±17.6) 


<0.01 ^ 


<35 


151 


90 


61 


<0.01 


35-59.9 


280 


222 


58 




60-100 


81 


75 


6 




1 >100 


5 


5 


0 




DRE 


Normal 


438 


94 


344 


<0.01 


Abnormal 


79 


31 


48 




Family history 


Yes 


12 


5 


7 


0.15 


■ No 


505 


120 


385 




Previous biopsy 


Yes 


78 


16 


62 


0.41 


No 


439 


109 


330 




! PSAD 


0.21 (±0.19) 


0.33 (±0.29) 


0.16 (±0.11) 


<0.01 


PCPT-RC score 


47.2 (±12.4) 


52.7 (±14.2) 


45.5 (±11.2) 


<0.01 


ERSPC-RC score 


29.7 (±14.9) 


41.7 (±17.9) 


25.8 (±11.4) 


<0.01 


PSA, prostate-specific antigen; PV, prostate volume; DRE, distal rectal examination; PSAD, PSA density; PCPT-RC, Prostate Cancer Prevention Trial Risk 
Calculator; ERSPC-RC, European Randomized Study for Screening in Prostate Cancer Risk Calculator 


TableZ Simple and Multi 


pie Logistic Regression Analysis for Biopsy Outcome 






Variable 


Univariate 




Multiple 




OR (95% CI) 


p value 


OR (95% CI) 


p value 


Age 


1.044(1.015-1.075) 


<0.01 


1.051 (1.015-1.088) 


<0.01 


Family history 


1.159 (0.823-1.984) 


0.16 






Previous biopsy 


0.781 (0.433-1.410) 


0.41 






Useof5-ARI 


7.017 (0.934-52.695) 


0.06 






TRUS 


2.471 (1.454-4.201) 


<0.01 


1.484 (0.773-2.851) 


0.24 


DRE 


2.363(1.425-3.920) 


<0.01 


1.708 (0.924-3.157) 


0.09 


PV 


0.948 (0.932-0.964) 


<0.01 


0.940 (0.923-0.958) 


<0.01 


PSA 


1.100(1.062-1.138) 


<0.01 


1.120(1.072-1.170) 


<0.01 



OR, odds ratio; CI, confidence interval; 5-ARI, 5 a-reductase inhibitor; TRUS, transrectal ultrasonography; DRE, distal rectal examination; PV, prostate vol- 
ume; PSA, prostate-specific antigen. 
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Tables. Comparison of Areas Under Receiving Operating Cliaracteristics Curves for tlie ERSPC-RC,tlie PCPT-RC, PSA, and PSAD 







AUC 


95% CI 




p value 










ERSPC 


PCPT 


PSAD 


PSA 




ERSPC 


0.774 


0.725-0.824 




<0.01 


0.54 


<0.01 


Total cohort 


PCPT 
PSAD 


0.645 
0.761 


0.586-0.704 
0.713-0.810 


<0.01 
0.54 


<0.01 


<0.01 


0.87 
<0.01 




PSA 


0.642 


0.584-0.700 


<0.01 


0.87 


<0.01 






ERSPC 


0.777 


0.725-0.829 




<0.01 


0.73 


<0.01 


PSA>4.0 


PPPT 
PSAD 


0.770 


U.JOU-V. / VU 

0.720-0.820 


0.73 


<0.01 




0 77 
<0.01 




PSA 


0.636 


0.575-0.698 


<0.01 


0.77 


<0.01 






ERSPC 


0.753 


0.689-0.817 




<0.01 


0.19 


<0.01 


PSAD >0. 15 


PCPT 
PSAD 


0.613 
0.711 


0.537-0.689 
0.641-0.781 


<0.01 
0.19 


<0.01 


<0.01 


0.05 
<0.01 




PSA 


0.560 


0.481-0.640 


<0.01 


0.05 


<0.01 





AUC, area under the curve; CI, confidence interval; ERSPC-RC, European Randomized Screening of Prostate Cancer Risk Calculator; PCPT-RC, Prostate Can- 
cer Prevention Trial Risk Calculator; PSA, prostate-specific antigen; PSAD, PSA density. 




1.00- 



0.75- 



ERSPC 0.50- 
PCPT i 
PSAD <Z> 
PSA 

0.25- 



0.00- 




0.00 0.25 0.50 0.75 1.00 0.00 0.25 0.50 075 1.00 0.00 0.25 0.50 0.75 1.00 

^ 1-specificity g 1-specificity q 1-specificity 

Fig. 1. Receiving operating characteristics curves for the ERSPC-RC, the PCPT-RC, PSA, and PSAD for (A) the total patient group, (B) the group with PSA >4.0 
ng/mL, (C) the group with PSAD >0.15. ERSPC-RC, European Randomized Screening of Prostate Cancer Risk Calculator; PCPT-RC, Prostate Cancer 
Prevention Trial Risk Calculator; PSA, prostate-specific antigen; PSAD, PSA density. 

cally significant difference between the AUC values for 
ERSPC-RC and PSAD among these two groups (Fig. IB 
and C, Table 3). 

Analyzing the calibration plots for the total patient group, 
both risk calculators tended to overestimate the risk of posi- 
tive biopsy. However, the overestimation of the ERSPC- 
RC tended to less than that of the PCPT-RC. When com- 
paring the ERSPC-RC and PSAD, the ERSPC-RC showed 
overall better calibration than PSAD, as shown in Fig. 2 
(Hosmer and Lemeshow Goodness-of-Fit Test Pr>ChiSq 
0. 19 for ERSPC, 0.02 for PSAD). 




20 30 40 
Calculated cancer risk (%) 

Fig. 2. Calibration plot between predicted and observed probabilities of posi- 
tive biopsy in the total cohort. ERSPC, European Randomized Screening of 
Prostate Cancer; PCPT, Prostate Cancer Prevention Trial; PSA, prostate- 
specific antigen; PSAD, PSA density. 



DISCUSSION 



Various efforts to develop predictive models for prostate 
cancer based on clinical, laboratory, ultrasonography and 
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magnetic resonance imaging results have been given toward 
improving the rate of prostate cancer detection. However, 
many urologists commonly use PSA level alone, PSAD, 
PSA velocity, DRE findings or TRUS findings in the practi- 
cal clinic. 

Recently, two prostate cancer risk calculators for the pre- 
diction of prostate cancer were developed and validated in 
several cohorts.'"* " Several studies reported that these tools 
are more beneficial than PSA alone in the assessment and 
decision making for patients with a risk of prostate cancer. 
Several external vaUdation reports have shown that using 
PCPT-RC and ERSPC-RC improve prediction compared to 
using PSA alone when deterrnining when to perform a bi- 
opsy.^' Also, some studies have found ERSPC-RC to have 
more prediction power and more accurately estimate the risk 
for prostate cancer compared to the PCPT-RC"" " Howev- 
er, there are no studies investigating the validity of the ER- 
SPC-RC or the PCPT-RC in Asians. There are also no stud- 
ies comparing the two calculators in Asian populations. 

External validations of the objectivity of nomograms are 
important to confirm the performance of these tests because 
they are often useful only for the cohorts from which they 
were developed. In addition, there is a limited efficacy of 
nomograms when externally validated with other study co- 
horts. Furthermore, it is possible to develop a novel nomo- 
gram for Korean to predict prostate cancer with our data- 
base rather than investigating the validity of Western based 
nomograms. However, there are over 100 different pub- 
lished prediction nomograms for prostate cancer through 
July 2007 in the field of urology.'^ Therefore, the present 
analysis aimed to address these concerns. Another main 
concem is that these two popular prostate cancer risk calcu- 
lators were released on the internet to the general public and 
can be confusing to patients who are worried about their 
own risk of prostate cancer. Therefore, external validation is 
needed to determine the objective performance of these on- 
line prostate cancer risk calculators. 

In the present study, the ERSPC-RC is a better prediction 
tool of prostate cancer after biopsy than the PCPT-RC, al- 
though the ERSPC-RC uses only five variables in compari- 
son to the seven variables of the PCPT-RC. When we com- 
pared the four predictive tools we found similar AUCs for 
ROC curves between the ERSPC-RC and PSAD and be- 
tween PCPT-RC and PSA level. This result is similar in 
two separate groups (PSA over 4.0 ng/mL group and PSAD 
over 0.15 group). 

Several studies showed that the performance of the PCPT- 



RC for predicting prostate cancer is higher than that of PSA 
level alone.*' " ''' However, we found that there was no sta- 
tistically significant difference observed in the present study. 
The PCPT-RC demonstrates that ethnicity and family histo- 
ry are the one of variables for predicting prostate cancer; 
however, the inclusion of 'other races' including Asian as a 
variable option reduces its ability to predict prostate cancer 
based on self-regulation. Another reason that we failed to 
observe a significant difference in the performance of PCPT- 
RC is that patients who had a family history of prostate 
cancer are not as prevalent in Asians compared with West- 
em cohorts. Many urologists in Korea find it difficult to un- 
cover a patient's actual family history in Korean prostate 
cancer patients. '^ The percentage of patients with a family 
history of prostate cancer was 2.3% (12 of 517 patients) in 
our total cohort. Just ten years ago, infomation about pros- 
tate cancer did not receive much attention in developing 
Asian countries, including Korea. For these reasons, the 
PCPT-RC has structural limitations to predict prostate can- 
cer for Asians although it was proven to be effective in sev- 
eral Western cohorts. 

The ERSPC-RC performed better than the other predic- 
tors according to the AUC values, although not statistically 
different from PSAD. For ERSPC-RC, prostate volume 
and TRUS abnormality must be gathered precisely by per- 
fomiing TRUS, but this tool does not include race or a fam- 
ily history of cancer, in contrast to the PCPT-RC. In Korea, 
urologists typically perform TRUS for patients who visited 
the out-patient clinic as the initial evaluation tool to mea- 
sure the prostate size. DRE information and TRUS abnor- 
mality is also gathered when TRUS is perfomed. There- 
fore, the ERSPC-RC appears to have more predictable 
power than the PCPT-RC according to the differences of 
the accuracy in the variables that were gathered for each 
tool. ERSPC-RC showed a slightly improved performance 
for predicting prostate cancer based on the effect of the oth- 
er added information from TRUS and DRE in comparison 
with PSAD, which is calculated using PSA levels and pros- 
tate volume. 

Nevertheless, compared to another Western studies, the 
AUC -based value of performance of the ERSPC-RC is low- 
er in our Korean cohort.''-^""' This result is reflected in the 
significant differences in clinical characteristics of prostate 
cancer such as PSA level, rate of DRE abnormalities and 
prostate volume in different races. '^■"* Therefore, the racial 
differences affect the accuracy of this nomogram. For the 
ERSPC-RC to achieve better performance than PSAD and 
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to demonstrate similar performance to that in other Western 
studies, more men who are diagnosed with prostate cancer 
after prostate biopsy or who have the significant prostate 
cancer can potentially have more proportion of the abnor- 
malities on DRE or TRUS than the patients who do not have 
prostate cancer However, there is as lower proportion of 
the abnomalities on DRE or TRUS in Asians, which plays 
an important role in ERSPC-RC in comparison with West- 
em counterparts . ' 

In the evaluation of calibration plots, both risk calculators 
tended to overestimate the risk of prostate cancer in the 
present study. Compared with the two risk calculators, the 
overestimation of the ERSPC-RC was lower than that of 
the PCPT-RC. The overestimation might be explained due 
to the differences between the cohorts as the source of the 
development for each risk calculators, even though the cali- 
bration plot was affected by multiple factors including sev- 
eral variables. Interestingly, the analysis of consistency of 
accuracy between the ERSPC-RC and PSAD showed that 
the ERSPC-RC more consistently predicts prostate cancer 
than PSAD. Despite this result, we cannot assume that the 
ERSPC-RC is more useful than PSAD because there was 
no significant difference between the AUC values between 
the ERSPC-RC and PSAD. 

There are some limitations in this study. It is unknown 
how many urologists use nomograms to predict prostate 
cancer before prostate biopsy pathology is reported or to 
decide when to perfom a biopsy. We can gain sufficient in- 
formation using the PSA, DRE and TRUS including pros- 
tate volume clinically. PSA and prostate volume have been 
proven to be excellent tools to decide when to perform pro- 
cedure biopsy.'**'^' Nevertheless, we analyzed the present 
study using Westem based prostate cancer risk calculators 
to externally validate them using Korean cohorts. This study 
was limited by the small sample size, which could explain 
why the Westem based prostate cancer risk calculators did 
not show a significant performance when compared to us- 
ing PSAD for Koreans. 

In conclusion, the ERSPC-RC improved predictive abili- 
ty of prostate cancer when compared with PCPT-RC and 
PSA in this Korean cohort. However, the difference in per- 
formance between the ERSPC-RC and PSAD is not signifi- 
cant. The Westem based prostate cancer risk calculators, in- 
cluding ERSPC-RC, may be sufficient for public use as an 
online prostate cancer risk calculator. However, we find no 
specific advantage to applying them for clinical practice in 
Korea. 
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